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^ (57) Abstract: A system architecture for thwarting denial of service attacks on a victim data center (20). The system includes a 
® first plurality of monitors (33) that monitor network traffic flow through the network (30). The first plurality of monitors (33) is 
O disposed at a second plurality of points (28) in the network (30). The system includes a central controller (27) that receives data 
from the plurality of monitors (33) over a network (30). The central controller (27) analyzes network traffic statistics (35) to identify 
^ malicious network traffic. 
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STATISTICS COLLECTION FOR NETWORK TRAFFIC 
Background 

5 This invention relates to techniques to thwart 

network-related denial of service attacks. 

In denial of service attacks, an attacker sends a 
large volume of malicious traffic to a victim. In one 
approach an attacker, via a computer system connected to 

10 the Internet infiltrates one or a plurality of computers 
at various data centers. Often the attacker will access 
the Internet through an Internet Service Provider (ISP) . 
The attacker by use of a malicious software program places 
the plurality of computers at the data centers under its 

15 control. When the attacker issues a command to the 

computers at the data centers, the machines send data out 
of the data centers at arbitrary times. These computers 
can simultaneously send large volumes of data over various 
times to the victim preventing the victim from responding 

20 to legitimate traffic. 

Summary 

According to an aspect of the present invention, a 
method of monitoring traffic flow in a monitor device 

25 disposed to receive network traffic packets includes 
producing statistics corresponding to a parameter of 
traffic flow to trace the source of an attack. The method 
also includes mapping the traffic flow into a plurality of 
buckets by applying a hash function "f(h)"to the 

30 parameter of the traffic flow to output an integer 
corresponding to one of the buckets and accumulating 
statistics from the packets. The method includes 
comparing the number of buckets to a threshold and 
determining whether the number of buckets should be 
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divided into more buckets or combined into fewer buckets 
based on comparing the number of buckets to the threshold. 

According to an additional aspect of the present 
invention, a computer program product residing on a 
5 computer readable for monitoring network traffic flow in a 
network includes instructions to cause a computer to map 
traffic flow into a plurality of buckets by applying a 
hash function "f(h)" to a parameter of the traffic flow to 
output an integer corresponding to one of the buckets. 

10 The program accumulates statistics from the packets and 

compares the accumulated statistic values from the buckets 
to configured threshold values corresponding to the number 
of buckets to determine that an event is of significance. 
The program adjusts the number of buckets as the number of 

15 buckets approaches a second threshold. 

According to an additional aspect of the present 
invention, a data collector to collect statistical 
information about network flows includes a computer 
readable medium and a computing device that executes a 

20 computer program product stored on the computer readable 
medium. The computer program product includes 
instructions to cause the computing device to map traffic 
flow into a plurality of buckets by applying a hash 
function "f (h)" to the parameter of the traffic flow to 

25 output an integer corresponding to one of the buckets and 
accumulate statistics from the packets. The program 
compares the accumulated statistic values from the buckets 
to configured threshold values corresponding to the number 
of buckets to determine that an event is of significance 

30 and adjusts the number of buckets as the number of buckets 
approaches a second threshold. The data collector also 
includes a port to link the data collector to a central 
control center. 
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One or more aspects of the invention may provide some 
or all of the following advantages. 

An attack may be designed to explode the number of 
buckets. Since each bucket consumes memory space, the 
5 attack can be designed to consume all available memory and 
crash the data collection processes and devices. 

The invention prevents that type of attack setting 
thresholds on the number of buckets.. As buckets approach 
a bucket threshold "Th", the process can take several 

10 buckets and divide them in more buckets or combine them 
into fewer buckets. The variable number of buckets 
dynamically adjusts the monitoring process to the amount 
of traffic and number of flows, so that monitoring is not 
vulnerable to a DoS attacks against its own resources. 

15 The variable number of buckets also helps to 

efficiently identify the source (s) of attack by breaking 
down traffic into different categories (buckets) and 
looking at the appropriate parameters and thresholds in 
each bucket. With the invention, traffic is monitored at 

20 multiple levels of granularity, from aggregate to 

individual flows. The invention can be applied to various 
types of monitoring, e.g., TCP packet ratios, repressor 
traffic, and so forth. 

25 
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Brief description of the drawings 
FIG. 1 is a block diagram of networked computers 
showing an architecture to thwart denial of service 
attacks. 

5 FIG. 2 is a block diagram depicting details of 

placement of a gateway. 

FIG. 3 is a block diagram depicting details of 
placement of data collectors. 

FIG. 4 is flow chart depicting a data collection 
10 process. 

FIG. 5 is a flow chart depicting details of a control 
center. 

FIG. 6 is a diagram depicting functional layers of a 
monitoring process. 
15 FIG. 7 is a diagram depicting one technique to gather 

statistics for use in algorithms that determine sources of 
an attack. 

FIG. 8 is a diagram depicting an- alternative 
technique to gather statistics for use in algorithms that 
20 determine sources of an attack. 

FIG. 9 is flow chart depicting a process to determine 
receipt of bad TCP traffic. 

FIG. 10 is flow chart depicting a process to defend 
against setup time connection attacks. 

25 

Detailed Description 
Referring to FIG. 1, an arrangement 10 to thwart 
denial of service attacks (DoS attacks) is shown. The 
arrangement 10 is used to thwart an attack on a victim 
30 data center 12, e.g., a web site or other network site 

under attack. The victim 12 is coupled to the Internet 14 
or other network. For example, the victim 12 has a web 
server located at a data center (not shown) . 
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An attacker via a computer system 16 that is 
connected to the Internet e.g., via an Internet 14 Service 
Provider (ISP) 18 or other approach, infiltrates one or a 
plurality of computers at various other sites or data 
5 centers 20a-20c. The attacker by use of a malicious 
software program 21 that is generally surreptitiously 
loaded on the computers of the data centers 20a-20c, 
places the plurality of computers in the data centers 20a- 
20c under its control. When the attacker issues a command 

10 to the data centers 20a-20c, the data centers 20a-20c send 
data out at arbitrary times. These data centers 20a-20c 
can simultaneously send large volumes of data at various 
times to the victim 12 to prevent the victim 12 from 
responding to legitimate traffic. 

15 The arrangement 10 to protect the victim includes a 

control center 24 that communicates with and controls 
gateways 26 and data collectors 28 disposed in the network 
14. The arrangement protects against DoS attacks via 
intelligent traffic analysis and filtering that is 

20 distributed throughout the network. The control center 24 
is coupled to the. gateways 26 and data collectors 28 by a 
hardened, redundant network 30. Gateways 26 and data 
collectors 28 are types of monitors that monitor and 
collect statistics on network traffic. In preferred 

25 embodiments, the network is inaccessible to the attacker. 
The gateway 26 devices are located at the edges of the 
Internet. 14, for instance, at the entry points of data 
centers. The gateway devices constantly analyze traffic, 
looking for congestion or traffic levels that indicate the 

30 onset of a DoS attack. The data collectors 28 are located 
inter alia at major peering points and network points of 
presence (PoPs) . The data collectors 28 sample packet 
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traffic, accumulate, and collect statistical information 
about network flows. 

All deployed devices e.g., gateways 26 and data 
collectors 28 are linked to the central control center. 
5 The control center aggregates traffic information and 
coordinates measures to track down and block the sources 
of an attack. The arrangement uses a distributed analysis 
emphasizing the underlying characteristics of a DoS 
attack, i.e., congestion and slow server response, to 

10 produce a robust and comprehensive DoS solution. Thus, 

this architecture 10 can stop new attacks rather than some 
solutions that can only stop previously seen attacks. 
Furthermore, the distributed architecture 10 will 
frequently stop an attack near its source, before it uses 

15 bandwidth on the wider Internet 14 or congests access 
links to the targeted victim 12. 

A virus is one way to get attacks started. When 
surfing the web page a user may download something, which 
contains a virus that puts the user's computer under the 

20 control of some hacker. In the future, that machine can 
be one of the machines that launches the attack. The 
attacker only needs a sufficient amount of bandwidth to 
get a sufficient number of requests out to the victim 12 
to be malicious. 

25 Referring to FIG. 2, details of an exemplary 

deployment of a gateway is shown. Other deployments are 
possible and the details of such deployments would depend 
on characteristics of the site, network, cost and other 
considerations. The gateway 26 is a program executing on 

30 a device, e.g., a computer 27 that is disposed at the edge 
of the data center 20 behind an edge router at the edge of 
the Internet 14. Additional details on the gateway 26 are 
discussed below and in the APPENDIX A. In a preferred 
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embodiment, a plurality of gateway devices are deployed at 
a corresponding plurality of locations, e.g., data centers 
or sites over the network, e.g., the Internet 14. There 
can be one gateway or a plurality of gateways at each data 
5 center, but that is not necessarily required. 

The gateway 26 includes a monitoring process 32 (FIG. 
6B) that monitors traffic that passes through the gateway 
as well as a communication process 33 that can communicate 
statistics collected in the gateway 26 with the data 

10 center 24. The gateway uses a separate interface over a 
private, redundant network, such as a modem 39 to 
communicate with the control center 24 over the hardened 
network 30. Other interface types besides a modem are 
possible. In addition, the gateway 26 can include 

15 processes 35 to allow an administrator to insert filters 
to filter out, i.e., discard packets that the device deems 
to be part of an attack, as determined by heuristics 
described below. 

An attack can be designed to either overload the 

20 servers or overload some part of the network 

infrastructure inside the victim site 12. Thus, the 
victim site 12 can include routers, switches, load 
balancers and other devices inside the data center that 
can be targeted by the attack. A particularly troublesome 

25 attack causes overload of upstream bandwidth. Upstream 
bandwidth is the capacity between the victim 12 data 
center 12a and one or a plurality of routers or switches 
belonging to the victim 12 data center's network service 
provider, which provides connectivity to the rest of the 

30 network, e.g., the Internet. 

For an exemplary configuration, the victim site 12 
can include a plurality of high bandwidth lines feeding a 
GSR (Gigabit Switch Router) . At the output of the GSR are 
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exit ports to various parts of the data center. The GSR 
is generally very high bandwidth and generally does not 
crash. The gateway 26 is placed behind the GSR and across 
some or all of the output ports of the GSR into the data 
5 center. This configuration allows the gateway 26 to 
monitor and control some or all of the traffic entering 
the data center without the need to provide routing 
functionality. 

Alternatively, a gateway 26 can tap a network line 

10 without being deployed physically in line, and it can 
control network traffic, for example, by dynamically 
installing filters on nearby routers. The gateway 26 
would install these filters on the appropriate routers via 
an out of band connection, i.e. a serial line or a 

15 dedicated network connection. Other arrangements are of 
course possible. 

Referring to FIG. 3, data collectors 28 are shown 
coupled to the network to tap or sample traffic from data 
centers 20a-20c. Although data collectors 28 can be 

20 dispersed throughout the network 14 they can be 

strategically disposed at peering points, i.e., points 
where network traffic from two or more different backbone 
providers meet. The data collectors 28 can also be 
disposed at points of presence (PoPs) . The data 

25 collectors 28 monitor and collect information pertaining 
to network traffic flow. The data collectors process 
statistics based on monitored network traffic that enters 
a peering point. Data collectors 28 include a monitoring 
process 32 (FIG. 6) as well as a communication process 

30 that communicates data to the control center over the 

hardened network 30. One or more data collector devices 
28 use the monitoring process to monitor one or more lines 
that enter the peering point. Each data collector 28 
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would be able to monitor one or more lines depending on 
the specifics of how. the network is configured and 
bandwidth requirements. 

The gateway 26 and data collector 26 are typically 
5 software programs that are executed on devices such as 
computers, routers, or switches. In one arrangement, 
packets pass through the gateway 26 disposed at the data 
center 22a and are sampled by the data collector. 

Referring to FIG. 4, the data collector 26 performs 

10 40 a sampling and statistic collection process 40. The 
data collector samples 42 one (1) packet in every (n) 
packets and has counters to collect statistics about every 
packet. The data collector 26 parses the information in 
the sampled packet. Information collected includes source 

15 information 44, which may be fake or spoofed, e.g., not 
correct information. It will also include destination 
information 46, which generally is accurate information. 
The data collector 28 collects that information but need 
not log the sampled packets. The data collector 28 

20 maintains a log over a period of time, e.g., in the last 
hour. As an example, the log that the data collector 26 
maintains is a log that specifies that the data collector 
has seen a certain number of packets, e.g., 10,000 packets 
of a particular kind, that apparently originated from a 

25 particular source (s) that are going to a particular 
destination. 

Based on rules 48 within the data collector 26, the 
data collector 26 analyzes 50 the collected statistics and 
may if necessary compose 52 a message that raises an 
30 alarm. Alternatively, the data collector can respond to 
queries concerning characteristics of traffic on the 
network. Typically, the queries can be for information 
pertaining to statistics. It can be in the form of an 
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answer to a question e.g., how many packets of a type did 
the data collector see or it can be a request to down load 
via the hardened network, the entire contents of the log. 
One rule is that when the data collector 26 starts 
5 sampling, the data collector periodically logs data and 
produces a log of a large plurality of different network 
flows over a period of time. 

Referring to FIG. 5, a deployment for the control 
center 24 is shown. The control center 24 receives 
10 information from one or more gateways 26 and data 

collectors 28 and performs appropriate analysis using an 
analysis process 62. The control center is a hardened 
site. 

The control center 24 has multiple upstream 

15 connections so that even during an attack it will have 
other ways to couple to the network 30. Several 
approaches can be used to harden the site. One approach 
can use special software between the site and the Internet 
14 to make it immune to attack. An approach is to have a 

20 physically separate network 30 connected to all of the 
devices, e.g., gateways 26 and data collectors 28. One 
exemplary embodiment of that physically separate network 
30, which is hardened, is the telephone system. Thus, 
each one of the data collectors 26 and gateways 26 

25 includes an interface to the separate network, e.g., a 
modem. The data center 26 also includes a corresponding 
interface to the separate network, e.g., a modem or a 
modem bank 60. 

With this approach, the redundant network 30 is not 

30 accessible to the attacker. The redundant network 30 thus 
is available to communicate between the data center 24 and 
data collectors and gateways to coordinate response to an 
attack. In essence, the network 30 used by the data 
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center to communicate with the data collectors 26 and 
gateways 26 is not available to the attacker. 
Alternatively, if less than complete assurance is 
required, the control center could be resistant to attack 
5 and still be connected to the Internet 14. 

The analysis process 62 that is executed on the 
control center 24 analyzes data from the gateways 26 and 
data collectors 28. The analysis process 62 tries to 
detect attacks on victim sites. The analysis process 62 

10 views attacks as belonging to, e.g., one of three classes 
of attack. Herein these classes of attack are denoted as 
low-grade with spoofing, low-grade without spoofing and 
high-grade whether spoofing or non-spoofing. 

A low-grade attack is an attack that does not take 

15 out upstream bandwidth. A low-grade attack does not 

significantly overburden the links between the Internet 14 
and the victim data center 12. The low-grade non-spoofing 
attack is the simplest type of attack to defend against. 
It simply requires identifying the source of the attack 

20 and a mechanism to notify an administrator at the victim 
site to install a filter or filters at appropriate points 
to discard traffic containing the source address 
associated with the attack. 

With a low-grade spoof ing-type attack, an attacker 

25 sends an IP-packet to a destination but fakes the source 
address. There is no way to enforce use of an accurate 
source address by a sender. During a spoofing attack, 
each one of the attacking machines will send a packet with 
a fake, e.g., randomly selected or generated source 

30 address. Under this type of attack, the victim 12 alone 
cannot thwart the attack. An administrator at the victim 
12 can try to put a filter on a router to stop the 
packets. However, there is no way for the administrator 
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to guess what the random address of the next packet will 
be. 

The control center 24 also includes a communication 
process 63 to send data to/from the gateways 26 and data 

5 collectors 28. The. gateway 26 at the victim 12 contacts 
the control center and notifies the control center 24 that 
the victim 12 data center is under a spoofing attack. The 
gateway 26 identifies itself by network address (e.g., 
static IP address if on the Internet 14), via a message to 

10 the control center 24. The message sent over the hardened 
network 30 indicates the type of attack, e.g., an attack 
from addresses that the victim 12 cannot stop because it 
is a spoofing type of attack. The control center queries 
data collectors 28 and asks which data collectors 28 are 

15 seeing suspicious traffic being sent to the victim 12. 

The packets from the attacker will have faked source 
addresses that will be changing with time. However, the 
control center can issue a query for this kind of packet 
by victim destination address. The data collectors 28 

20 reply with the information collected. Based on that 
collected information from the data collectors 28, the 
control center can then determine what data centers are 
performing the spoofing on the victim 12. 

In the present configuration, there are two possible 

25 sources of attack traffic: either the attacker is behind a 
gateway 26 or not. If the attacker is behind a gateway 
26, the' control center issues a request to the appropriate 
gateway 26 to block the attacking traffic, e.g. by 
allowing the appropriate gateway 26 to discard traffic, 

30 e.g., packets that contain the victim 12 destination 
address. The gateway 26 stops that traffic in a 
transparent manner. If the attacker is not behind a 
gateway 26, data collectors 28 are used to provide 
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information about possible locations of the attackers. 
The availability of information from data collectors 28 
increases the speed with which attackers are discovered. 
The data collectors 28 are positioned at network switching 
5 points that see a high volume of traffic, which minimizes 
the required number of deployed data collectors. 

The high-grade attacks are attacks that take out the 
link between the victim 12 data center and the Internet 
14. With a high-grade attack it does not matter whether 

10 the victim 12 is spoofed or not. Under a high-grade 

attack, the attack requires cooperation just like the low 
grade spoofing attack. Thus, the same thwarting mechanism 
is used for either spoofing or non-spoofing, e.g., using 
information from the data collectors 28 to identify 

15 attacking networks. This information is used to either 
automatically shutdown traffic having the victim's 
destination address at the appropriate gateways 26 or is 
used to identify networks or data centers from which the 
attack is originating and to follow up with calls to the 

20 appropriate administrators. 

Referring to FIG. 6, a monitoring process 32 is 
shown. The monitoring process 32 can be deployed on data 
collectors 28 as well as gateways 26. The monitoring 
process 32 includes a process 32a to collect statistics of 

25 packets that pass by the data collectors 28 or through the 
gateways 26. The monitoring process 32 also includes 
several processes 32b to identify, malicious traffic flows 
based on the collected statistics as further described 
below. 

30 Referring to FIG. 7, the gateways 2 6 and data 

collectors 28 are capable of looking at multiple levels of 
granularity. The gateways 26 and data collectors have 
monitoring process 32 used to measure some parameter of 
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traffic flow. One goal of the gateways 26 and data 
collectors 28 is to measure some parameter of network 
traffic. This information collected by the gateways 26 
and data collectors is used to trace the source of an 
5 attack. 

One of the algorithms to measure parameters of 
traffic flow divides the traffic flow into buckets. For 
example, consider one simple parameter, the count of how 
many packets a data collector or gateway examines. An 

10 algorithm to track the . count of this parameter starts with 
a predefined number of buckets, e.g., "N" buckets. The 
buckets are implemented as storage areas in the memory 
space of the data collector or gateway device. The 
algorithm will use some hash function "f(h)", which takes 
. 15 the packet and outputs an integer that corresponds to one 
of the buckets w Bi-B N ". Statistics from the packets start 
accumulating in the buckets X> B X - B N ". The buckets "Bi - B N " 
are configured with threshold values "Th." As the 
contents of the buckets Bi - B N reach the configured 

20 thresholds values "Th", (e.g., compare values of packet 

count or packet rate to threshold) , the monitoring process 
32 deems that event to be of significance. The monitoring 
process 32 takes that bucket, e.g., B± and divides that 
bucket Bi into some other number M of new buckets Bu - B iM . 

25 Each of the new buckets Bu -.B iM contains values 

appropriately derived from the original bucket B±. Also, 
the hash function is extended to map to N+M-l "h-»N+M-l" 
values, rather than the original N values. 

An attack designed to use the algorithm of FIG. 6 

30 against a gateway 26 or a data collector 28 might send 
packets in such a fashion as to explode the number of 
buckets. Since each bucket consumes memory space, the 
attack can be designed to consume all available memory and 
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crash the device, e.g., computer on which the monitoring 
process 32 executes. There are ways of preventing that 
type of attack on the monitoring process 32. One way is 
to make the hash function change periodically, e.g., 
5 randomly. Also the hash function is secret so that the 
packets are reassigned to different buckets in ways 
unknown to the attackers. 

Referring to FIG. 8, a second method is that instead 
of using just thresholds and values inside a given bucket, 

10 the monitoring process 32 also sets thresholds on the 

number of buckets. As the gateway 26 or data collector 28 
approaches a bucket threshold "Th", the gateway 26 or data 
collector 28 have the ability to take several buckets B a - 
B 3 and divide them in more buckets Bi - B 4 or combine them 

15 into fewer bucket Bi-B 2 . 

The function of the variable number of buckets is to 
dynamically adjust the monitoring process to the amount of 
traffic and number of flows, so that the monitoring device 
(e.g., gateway 26 or data collector 28) is not vulnerable 

20 to DoS attacks against its own resources. The variable 
number of buckets also efficiently identifies the 
source (s) of attack by breaking down traffic into 
different categories (buckets) and looking at the 
appropriate parameters and thresholds in each bucket. 

25 Thus, with multi-level analysis as discussed in FIGS. 

6 and 7, traffic is monitored at multiple levels of 
granularity, from aggregate to individual flows. Multi- 
level analysis can be applied to all types of monitoring 
(i.e. TCP packet ratios, repressor traffic, etc. discussed 

30 below) except TCP SYN proxying (because the latter 
requires per-connection monitoring of all half-open 
connections as discussed below). 
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The monitoring process 32 has the gateway 26 or the 
data collectors 28 keep track of a metric (such as packet 
ratio) for each of n traffic buckets. (If n=l, the 
monitoring process 32 tracks the metric for all traffic in 
5 the aggregate.) The monitoring process 32 places packets 
into buckets according to a hash function of the source or 
destination address. If the metric in any bucket exceeds 
a given "suspicious" threshold, that bucket is split into 
several smaller buckets, and the metric is tracked 

10 individually for each new bucket. In the limit, each 
bucket can correspond to a single flow (source 
address/port and destination address/port pair) . The 
resulting per-flow monitoring is resilient to denial-of- 
service attacks. If the number of buckets exceeds a given 

15 memory limit (for example, due to a many-flow spoofing 

attack) , several fine-grain buckets can be aggregated into 
a single coarse-grain bucket. The hash function for 
placing packets into traffic buckets is secret and changes 
periodically, thwarting attacks based on carefully chosen 

20 addresses . 

In the worst case, an attacker actually spoofs 
packets from all possible addresses. An IP address, for 
example is 32 bits long. This address length allows for 
approximately 4 billion possible random addresses and 

25 makes it impossible for the gateway at the victim site 12 
to identify the attacker. In that worst case, the gateway 
26 calls the control center, indicates the address of the 
gateway 26, and conveys that the gateway 26 is receiving 
unreasonably high levels of random traffic. The control 

30 center 24 contacts the data collectors 28. The control 
center 24 analyzes the statistics collected by the data 
collectors 28 to try to determine the source of the 
traffic. 
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Egress filtering is a recommended Internet 14 best 
practice procedure that does not allow any packets out of 
a network unless the source address belongs to that 
network. Egress filtering prevents hosts on that network 
5 from sending out packets with completely random source 
addresses. Rather, the space of usable fake addresses is 
limited by the size of the host's network address space, 
and may range up to 24 bits rather than the full 32 bits. 
If an attacker is attacking from a network that performs 

10 egress filtering, then all the attack traffic reaching a 
victim will fall into a smaller number of buckets, those 
corresponding to the source network address. In this way, 
the gateway 26 can identify the approximate source of the 
attack without necessarily relying on the control center 

15 or data collectors. 

Several methods can be used separately or in 
combination to identify, malicious traffic flows. For 
example, the gateway 26 can detect DoS attacks and 
identify malicious flows or source addresses using at 

20 least one or more of the following methods including: 
analyzing packet ratios of TCP-like traffic; analyzing 
"repressor" traffic for particular types of normal 
traffic; performing TCP handshake analysis; performing 
various types of packet analysis at packet layers 3-7; and 

25 logging/historical analysis. 

Packet ratios for TCP-like traffic. 

The Transmission Control Protocol (TCP) is a protocol 
in which a connection between two hosts, a client C, e.g. 
30 a web browser, and a server S, e.g. a web server, involves 
packets traveling in both directions, between C and S and 
between S and C. When C sends data to S and S receives 
it, S replies with an ACK ("acknowledgement") packet. If 
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C does not receive the ACK, it will eventually try to 
retransmit the data to S, to implement TCP's reliable 
delivery property. In general , a server S will 
acknowledge (send an ACK) for every packet or every second 
5 packet. 

Referring to FIG. 9, the monitoring process in the 
gateway 26 can examine 82 a ratio of incoming to outgoing 
TCP packets for a particular set of machines, e.g. web 
servers. The monitoring process can compare 84 the ratio 

10 to a threshold value. The monitoring process can store 8 6 
this ratio, time stamp it, etc. and conduct an ongoing 
analysis 88 to determine over time for example how much 
and how often it exceeds that ratio. As the ratio grows 
increasingly beyond 2:1, e.g., to about 3:1 or so, it is 

15 an increasing indication that the machines are receiving 
bad TCP traffic, e.g. packets that are not part of any 
established TCP connection, or that they are too 
overloaded to acknowledge the requests. This ratio is one 
of the parameters measured using the multiple-bucket 

20 algorithm described previously. 

The gateway 26 divides traffic into multiple buckets, 
e.g. by source network address, and tracks the ratio of 
ingoing to outgoing traffic for each bucket. As the ratio 
for one bucket becomes skewed, the gateway 26 may 

25 subdivide that bucket to obtain a more detailed view. The 
gateway 26 raises 90 a warning or alarm to the data center 
24 and/or to the administrators at the victim site 12. 

Repressor traffic 
30 The phrase "repressor traffic" as used herein refers 

to any network traffic that is indicative of problems or a 
potential attack in a main flow of traffic. A gateway 26 
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may use repressor traffic analysis to identify such, 
problems and stop or repress a corresponding attack. 

One example of repressor traffic is ICMP port 
unreachable messages. These messages are generated by an 
5 end host when it receives a packet on a port that is not 
responding to requests. The message contains header 
information from the packet in question. The gateway 26 
can analyze the port unreachable messages and use them to 
generate logs for forensic purposes or to selectively 
10 block future messages similar to the ones that caused the 
ICMP messages. 

TCP handshake analysis 

A TCP connection between two hosts on the network is 

15 initiated via a three-way handshake. The client, e.g. C, 
sends the server, e.g. S, a SYN ("synchronize") packet. S 
the server replies with a SYN ACK ("synchronize 
acknowledgment") packet. The client C replies to the SYN 
ACK with an ACK ("acknowledgment") packet. At this point, 

20 appropriate states to manage the connection are 
established on both. sides. 

During a TCP SYN flood attack, a server is sent many 
SYN packets but the attacking site never responds to the 
corresponding SYN ACKs with ACK packets. The resulting 

25 "half-open" connections take up state on the server and 
can prevent the server from opening up legitimate 
connections until the half -open connection expires, which 
usually takes 2-3 minutes. By constantly sending more SYN 
packets, an attacker can effectively prevent a server from 

30 serving any legitimate connection requests. 

Referring to FIG. 10, in an active configuration, a 
gateway 26 can defend against SYN flood attacks. During 
connection setup, the gateway forwards 102 a SYN packet 
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from a client to a server. The gateway forwards 104 a 
resulting SYN ACK packet from a server to client and 
immediately sends 106 ACK packet to the server, closing a 
three-way handshake. The gateway maintains the resulting 
5 connection for a timeout period 108. If the ACK packet 
does not arrive from client to server 110 , the gateway 
sends 112 a RST ("reset") to the server to close the 
connection. If the ACK arrives 114, gateway forwards 116 
the ACK and forgets 118 about the connection, forwarding 

10 subsequent packets for that connection. A variable 

timeout 120 period can be used. The variable time out 
period can be inversely proportional to number of 
connections for which a first ACK packet from client has 
not been received. If gateway 26 is placed inline in the 

15 network, when number of non-ACK'ed connections reaches a 
configurable threshold 122, the gateway will not forward 
any new SYNs until it finishes sending RSTs for those 
connections . 

In a passive configuration, a gateway 26 can 

20 similarly keep track of ratios of SYNs to SYN ACKs and SYN 
ACKs to ACKs, and raise appropriate alarms when a SYN 
flood attack situation occurs. 

Layer 3-7 analysis. 

25 With layer 3-7 analysis, the gateway 26 looks at 

various traffic properties at network packet layers 3 
through 7 to identify attacks and malicious flows. These 
layers are often referred to as layers of the Open System 
Interconnection (OSI) reference model and are network, 

30 transport, session, presentation and application layers 
respectively. Some examples of characteristics that the 
gateway may look for include: 
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1. Unusual amounts of IP fragmentation, or fragmented 
IP packets with bad or overlapping fragment offsets. 

2. IP packets with obviously bad source addresses, or 
ICMP packets with broadcast destination addresses. 

3. TCP or UDP packets to unused ports. 
4 - TCP segments advertizing unusually small window ! 

sizes, which may indicate load on server, or TCP ACK . 
packets not belonging to a known connection. 

5. Frequent reloads that are sustained at a rate 
higher than plausible for a human user over a persistent 
HTTP connection. 

Logging and historical traffic analysis 

The gateways 26 and data collectors 28 keep 
15 statistical summary information of traffic over different 
periods of time and at different levels of detail. For 
example, a gateway 26 may keep mean and standard deviation 
for a chosen set of parameters across a chosen set of 
time-periods. The parameters may include source and 
20 destination host or network addresses, protocols, types of 
packets, number of open connections or of packets sent in 
either direction, etc. Time periods for statistical 
aggregation may range from minutes to weeks. The device 
will have configurable thresholds and will raise warnings 
25 when one of the measured parameters exceeds the 
corresponding threshold. 

The gateway 26 can also log packets. In addition to 
logging full packet streams, the gateway 26 has the 
capability to log only specific packets identified as part 
30 of an attack (e.g., fragmented UDP packets or TCP SYN 
packets that are part of a SYN flood attack) . This 
feature of the gateway 26 enables administrators to 
quickly identify the important properties of the attack. 
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Building a DoS-resistant network 

The network of gateways 26, data collectors 28, and 
control center 24 are made DoS resistant by combining and 
5 applying several techniques. These techniques include the 
use of SYN cookies and "hashcash" to make devices more 
resistant to SYN floods and other attacks that occur at 
connection setup time. Also, the data center can use 
authentication and encryption for all connections. 

10 Private/public key pairs are placed on machines before 
deployment to avoid man-in-the-middle attacks. The 
control center 24 can have multiple physical connections 
from different upstream network service providers. The 
network over which the data center communicates between 

15 gateways and data collectors is a private redundant 
network that is inaccessible to attackers. 

Information exchange between gateways/data collectors 
and the control center is efficient by transferring only 
statistical data or minimal header information, and by 

20 compressing all data. 

This application includes an APPENDIX A attached 
hereto and incorporated herein by reference. APPENDIX A 
includes Click code for monitor software. 

This application also includes an APPENDIX B attached 

25 hereto and incorporated herein by reference. APPENDIX B 
sets out additional modules for a Click Router that 
pertains to thwarting DoS attacks. "Click" is a modular 
software router system developed by The Massachusetts 
Institute of Technology' s Parallel and Distributed 

30 Operating Systems group. A Click router is an 

interconnected collection of modules or elements used to 
control a router's behavior when implemented on a computer 
system. 
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Other embodiments are within the scope of the 
appended claims. 
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APPENDIX A 

network monitor/defender 

// 

5 // Has two operating modes: if MONITOR is defined, it monitors the network 
// instead of defending against DDoS attacks. 

// 

// ICMP_RATE specifies how many ICMP packets allowed per second. Default is 
// 500. UDP_NF_RATE specifies how many non-fragmented UDP (and other non- 
10 TCP 

// non-ICMP) packets allowed per second. Default is 3000. UDP_F_RATE specifies 
// how many fragmented UDP (and other non-TCP non-ICMP) packets allowed per 
// second. Default is 1000. All the SNIFF rates specify how many bad packets 
// sniffed per second. 
15 II 

II For example, if MONITOR is not defiend, and all SNIFF rates are 0, then the 
// configuration defends against DDoS attacks, but does not report bad 
// packets. 

// 

20 // can read: 

// - tcpjnonitor: aggregate rates of different TCP packets 

// - ntcp_monitor: aggregate rates of different non TCP packets 

// - icmp_unreach_counter: rate of ICMP unreachable pkts 

// _ tcp_ratemon: incoming and outgoing TCP rates, grouped by non-local hosts 

25 // - ntcp_ratemon: incoming UDP rates, grouped by non-local hosts 
// 

// Note: handles full fast ethernet, around 134,500 64 byte packets, from 
// attacker. 

// 

30 // 

//TODO: 

// - fragmented packet monitor 

#ifridefICMP_RATE 
35 #defineICMP_RATE 500 
#endif 

#ifhdef UDP_NF_RATE 
#defineUDP_NF_RATE 2000 
40 #endif 

#imdefUDP_F_RATE 
#defineUDP_F_RATE 1000 
#endif 



45 



#ifndefSUSP_SNIFF 

#define SUSP_SNIFF 1 00 // # of suspicious pkts sniffed per sec 
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#endif 

#ifiidefTCP_SNIFF 

#define TCP_SNIFF 100 // # of TCP flood pkts sniffed per sec 
5 #endif 



10 



#ifhdefICMP_SNIFF 
#define ICMP_SNEFF 
#endif 

#ifndef UDP_NF_SNIFF 
#define UDP_NF_SNIFF 
#endif 



75 // # of ICMP flood pkts sniffed per sec 



75 // # of non-frag UDP flood pkts sniffed per sec 



15 #ifhdefUDP_F_SNIFF 
#define UDP_F_SNIFF 
#endif 



75 // # of frag UDP flood pkts sniffed per sec 



20 



#include "if.click" 
#include "sampler.click" 



#include "sniffer.click" 
ds_sniffer :: Sniffer(mazu_ds); 
25 syn_sniffer :: Sniffer(mazu_syn); 
tcp_sniffer :: Sniffer(mazu_tcp); 
ntcp_sniffer :: Sniffer(mazu_ntcp); 

#include "synkill.click" 
30 #ifdef MONITOR 

tcpsynkill :: SYNKill(true); 
#else 

tcpsynkill :: SYNKill(false); 
#endif 

35 



40 



// 

// discards suspicious packets 

// 

#include "ds.click" 

ds :: DetectSuspicious(Ol); 



from_world -> ds; 
45 ds [0] -> is_tcp_to_victim :: IPClassifier(tcp, -); 
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#ifdefMONITOR 

ds [1] -> dsjsplit :: RatedSampler(SUSPJSNnT); 
#else 

ds [1] -> ds_split :: RatedSpUtter(SUSPJSNIFF); 
5 #endif 

ds_split [1] -> ds_sniffer; 
dsjsplit [0] 
#ifdef MONITOR 
10 -> is_tcp_to_victim; 
#else 

-> Discard; 
#endif 

15 // 

// monitor TCP ratio 

// 

#include "monitor.click" 
20 tcp_ratemon :: TCPTrafficMonitor; 

isjcpJo_victim [0] -> tcpjnonitor :: TCPMonitor -> [0] tcpjratemon; 
from_victim -> is_tcp_to_world :: IPClassifier(tcp, -); 
is_tcpJ:o_world [0] -> [1] tcp__ratemon; 

25 

// 

// enforce correct TCP ratio 

// 

30 check Jtepjratio :: RatioShaper(l, 2,40,0.2); 
tcpjratemon [0] -> check_tcp_ratio; 

#ifdefMONITOR 

checkjcpjatio [1] -> tcp_split :: RatedSampler(TCPJSNIFF); 
35 #else 

check_tcp_ratio [1] -> tcp_split :: RatedSpUtter(TCP_SNIFF); 
#endif 

tcp_split [1] -> tcp_sniffer; 
40 tcp_split [0] 

#ifdef MONITOR 
-> [0] tcpsynkill; 
#else 
-> Discard; 
45 #endif 
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// 

// prevent SYN bomb 

// 

5 check_tcp_ratio [0] -> [0] tcpsynkill; 
tcp_ratemon [1] -> [1] tcpsynkill; 

tcpsynkill [0] -> to_victim_sl; 
tcpsynkill [1] -> to_world; 

10 

tcpsynkill [2] 
#ifdefMONITOR 

-> syn_sniffer; 
Idle -> to_victim_prio; 
15 #else ■ 

-> tcpsynkill_split : : Tee(2) 
tcpsynkill_split [0] -> to_victim_prio; 
tcpsynkill_split [1] -> syn_sniffer, 
#endif 

20 

// 

// monitor all non TCP traffic 

// 

25 ntcp_ratemon :: IPRateMonitor(PACKETS, 0, 1, 100, 4096, false); 

is_tcp_to_victim [1] -> ntcp_monitor :: NonTCPMonitor -> ntcp_t :: Tee(2); 
ntcp_t [0] -> [0] ntcpjratemon [0] -> Discard; 
ntcp_t [1] -> [1] ntcp_ratemon; 

30 // 

// rate limit ICMP traffic 

// 

ntcpjratemon [1] -> is_icmp :: IPClassifier(icmp, -); 
35 is_icmp [0] -> icmp_split :: RatedSplitter (ICMP_RATE); 

icmp_split [1] -> to_victim_s2; 

icmp_split [0] -> icmp_sample :: RatedSampler (ICMP_SNIFF); 

40 icmp_sample [1] -> ntcp_sni£fer, 

icmp_sample [0] 

#ifdefMONITOR 
-> to_victim_s2; 

#else 
45 -> Discard; 

#endif 



-27- 



WO 02/21296 



PCT/US01/27394 



// 

// rate limit other non TCP traffic (mostly UDP) 

// 

5 is_icmp [1] -> isjrag :: Classifier(6/0000, -); 

is_frag [0] -> udp_split :: RatedSplitter (UDPJNF_RATE); 

udpjsplit [0] -> udp_sample :: RatedSampler (UDP_NF_SNIFF); 
10 udp_sample [1] -> ntcp_sniffer; 

udp_sample [0] 

#ifdefMONITOR 
-> to_victim_s2; 

#else 
15 -> Discard; 

#endif 

is_frag [1] -> udpXsplit RatedSplitter (UDPJPJRATE); 

20 udpjfjsplit [0] -> udpJFsample :: RatedSampler (UDP_F_SN1FF); 
udp_f_sample [1] -> ntcp_sniffer; 
udp JLsample [0] 
#ifdefMONITOR 
-> to_victim_s2; 
25 #else 

-> Discard; 
#endif 



30 // further shape non-TCP traffic with ICMP dest unreachable packets 

II 

is_tcpJo_world [1] -> is_icmp_unreach :: IPClassifier(icmp type 3, -); 
is_icmp_unreach [ 1 ] -> to_world; 
35 is_icmp_unreach [0] 

-> icmp_unreach_counter :: Counter; 

tfifodefMONTTOR 

40 icmp_unreach_counter -> icmpeir_sample :: RatedSampler (UNREACHJ3NIFF); 

icmperr_sample [1] -> ntcp_sniffer; 

icmperr_catcher :: AdaptiveShaper(.l, 50); 

udp_spiTt [1] -> [0] icmperr_catcher [0] -> tojvictim_s2; 

udp_f_split [1] -> [0] icmperr_catcher; 
45 icmperr_sample [0] -> [1] icmperr^catcher [1] -> to_world; 
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udp_split [1] -> to_victim_s2; 
udp_f_split [1] -> to_victim_s2; 
5 icmp_unreach_counter [0] -> to_world; 

#endif 
10 = if.click 
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// input/output ethemet interface for router 

15 // u u , 

// this configuration file leaves the following elements to be hooked up: 

// 

// from_victim: packets coming from victim 
// from_world: packets coming from world 
20 //to_world: packets going to world 

// to_victim_prio : high priority packets going to victim 

// to_victim_sl : best effort packets going to victim, tickets = 4 

// to_victim_s2: best effort packets going to victim, tickets = 1 

// 

25 // see bridge.click for a simple example of how to use this configuration. 

//victim network is 1.0.0.0/8 (ethl, 00:C0:95:E2:A8:A0) 
// world network is 2.0.0.0/8 (eth2, 00:C0:95:E2:A8:A1) and 
// 3.0.0.0/8 (etb.3, 00:C0:95:E1:B5:38) 

30 

// ethernet input/output, forwarding, and arp machinery 

tol :: ToLinux; 
t :: Tee(6); 
35 t[5]->tol; 

arpql _prio :: ARPQuerier(1.0.0.1, 00:C0:95:E2A8:A0); 
arpql_sl :: ARPQuerier(1.0.0.1, 00:C0:95:E2A8:A0); 
arpql_s2 :: ARPQuerier(1.0.0.1, 00:C0:95:E2:A8 AO); 
40 arl :: ARPResponder(l .0.0. 1/32 00:C0:95:E2:A8:A0); 
arpq2 :: ARPQuerier(2.0.0.1, 00:C0:95:E2A8:A1); 
ar2 :: ARPResponder(2.0.0.1/32 00:C0:95:E2A8A1); 
arpq3 :: ARPQuerier(3.0.0.1, 00:CO:95:E1:B5:38); 
ar3 :: ARPResponder(3 .0.0. 1/32 00:C0:95:E1:B5:38); 

45 
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psched :: PrioSched; 
ssched :: StrideSched (4,1); 

outl_sl :: Queue(256) -> [0] ssched; 
5 outl_s2 :: Queue(256) -> [1] ssched; 
outl_prio :: Queue(256) -> [0] psched; 
ssched -> [1] psched; 

psched[0] -> to_victim_counter :: Counter -> todevl :: ToDevice(ethl); 

10 out2 :: Queue(1024) -> todev2 :: ToDevice(eth2); 
out3 :: Queue(1024) -> todev3 :: ToDevice(eth3); 

to_victini_prio :: Counter -> tvpc :: Classifier(16/01, -); 
tvpc [0] -> [0]arpql_prio -> outljprio; 
15 tvpc [1] -> Discard; 

to_victim_sl :: Counter -> tvslc :: Classifier(16/01 3 -); 
tvslc [0] -> [G]arpql_sl -> outl_sl; 
tvslc [1] -> Discard; 

20 

to_victim_s2 :: Counter -> tvs2c :: Classifier(16/01, -); 
tvs2c [0] -> [0]arpql_s2 -> outl_s2; 
tvs2c [1] -> Discard; 

25 tojworld :: Counter -> twc :: Classifier(16/02, 16/03, -); 
twc [0] -> [0]arpq2 -> out2; 
twc [1] -> [0]arpq3 -> out3; 
twc [2] -> Discard; 

30 from_yictim :: GetBPAddress(16); 
frornworld :: GetIPAddress(16); 

indevl :: PollDevice(ethl); 
cl :: Classifier (12/0806 20/0001, 
35 12/0806 20/0002, 

12/0800, 

-); 

indevl -> from_victim_counter :: Counter -> cl; 

cl [0] -> arl ->outl_sl; 
40 cl [1] -> t; 

cl [2] -> Strip(14) -> MarklPHeader -> from_victim; 

cl [3] -> Discard; 

t[0] -> [1] arpql_prio; 

t[l]->[l] arpql^sl; 
45 t[2] -> [1] arpql_s2; 
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indev2 :: PollDevice(eth2); 
c2 :: Classifier (12/0806 20/0001, 
12/0806 20/0002, 
12/0800, 

5 -); 

indev2 -> from_attackers_counter :: Counter -> c2; 
c2 [0] -> ar2 -> out2; 
c2[l] ->t; 

c2 [2] -> Strip(14) -> MarklPHeader -> from_world; 
10 c2 [3] -> Discard; 
t[3] -> [1] arpq2; 

indev3 :: PollDevice(eth3); 
c3 :: Classifier (12/0806 20/0001, 
15 12/0806 20/0002, 

12/0800, 

-); 

indev3 -> c3; 
c3 [0] -> ar3 -> out3; 
20 c3[l]->t; 

c3 [2] -> Strip(14) -> MarklPHeader -> from_world; 

c3 [3] -> Discard; 

t[4]->[l]arpq3; 

25 ScheduleInfo(todevl 10, indevl 1, 
todev2 10,indev2 1, 
todev3 10, indev3 1); 



30 

= sampler.click 



elementclass RatedSampler { 
35 $rate | 

input -> s :: RatedSplitter($rate); 

s [0] -> [0] output; 

s[l]->t::Tee; 

t [0] -> [0] output; 
40 t [1] -> [1] output; 

}; 

elementclass ProbSampler { 
$prob | 

45 input -> s : : ProbSplitter($prob); 
s [0] -> [0] output; 
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s[l]->t::Tee; 
t [0] -> [0] output; 
t [1] -> [1] output; 

}; 

= sniffer.click 



// setup a sniffer device, with a testing IP network address 
10 // 

// argument: name of the device to setup and send packet to 

elementclass Sniffer { 
$dev| 

15 FromLinux($dev, 192.0.2.0/24) -> Discard; 

input -> sniffer_ctr :: Counter 
-> ToLinuxSniffers($dev); 

}; 

// note: ToLinuxSniffers take 2 us 
= synkulclick 



20 



25 



// 

// SYNKill 

// 

// argument: true if monitor only, false if defend 
30 // 

// expects: input 0 - TCP packets with IP header to victim network 
// input 1 - TCP packets with IP header to rest of internet 

// 

// action: protects against SYN flood by prematurely finishing the three way 
35 // handshake protocol. 

// 

// outputs: output 0 - TCP packets to victim network 
// output 1 - TCP packets to rest of internet 
// output 2 - control packets (created by TCPSYNProxy) to victim 
40 // 

elementclass SYNKill { 
Smonitor | 

// TCPSYNProxy(MAX_CONNS, THRESH, MINTMEOUT, MAXTIMEOUT, 
45 PASSIVE); 

tcpsynproxy :: TCPSYNProxy(128, 4, 8, 80, Smonitor); 
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input [0] -> [0] tcpsynproxy [0] -> [0] output; 
input [1] -> [1] tq)synproxy [1] -> [1] output; 
tcpsynproxy [2] 
->GetIPAddress(16) 
5 -> [2] output; 

}; 

— ds.ciick 



10 

// 

// DetectSuspicious 

// 

// argument: takes in the victim network address and mask, for example: 
15 // DetectSuspicious(121A0400%EFFFFF00) 

// 

// expects: IP packets. 

// 

// action: detects packets with bad source addresses; 
20 // detects direct broadcast packets; 
// detects ICMP redirects. 

// 

// outputs: output 0 push out accepted packets, unmodified; 
// output 1 push out rejected packets, unmodified. 
25 // 

elementclass DetectSuspicious { 
$vnet| 

30 // see http://ww.ietf.orgto for a 

// list of bad source addresses to block out. we also block out packets with 
// broadcast dst addresses. 

bad_addr_filter :: Classified 

35 12/$vnet, // port 0: victim network address 

12/00, // port 1 : 0.0.0.0/8 (special purpose) 

12/7F, // port 2: 127.0.0.0/8 (loopback) 

12/OA, // port 3: 10.0.0.0/8 (private network) 

12/AC10%FFF0, // port 4: 172.16.0.0/12 (private network) 

40 12/C0A8, // port 5: 192.168.0.0/16 (private network) 

12/A9FE, // port 6: 169.254.0.0/16 (autoconf addr) 

12/C0000200%FFFFFFOO, //port 7: 192.0.2.0/24 (testing addr) 
12/E0%F0, // port 8: 224.0.0.0/4 (class D - multicast) 

12/F0%F0, // port 9: 240.0.0.0/4 (class E - reserved) 

45 12/00FFFFFF%00FFFFFF, // port 10: broadcast saddr X.255.255.255 
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12/OOOOFFFP/oOOOOFFFF, // port 1 1: broadcast saddr X.Y.255.255 
12/0O0000FF%000000FF, // port 12: broadcast saddr X.Y.Z.255 
16/00FFFFFF%00FFFFFF, // port 13: broadcast daddr X.255.255.255 
16/OOO0FFFF%00O0FFFF, // port 14: broadcast daddr X.Y.255.255 
5 16/0OO0OOFF%OO0000FF, // port 1 5: broadcast daddr X. YZ.255 
9/01, //port 16: ICMP packets 

-); 

input ->bad_addr_filten 
10 bad_addr_filter [0] ->[1] output; 

bad_addr_filter [1] ->[1] output; 

bad_addr_filter [2] -> [1] output; 

bad_addr_filter [3] -> [1] oulput; 

bad_addr_filter [4] ->[1] output; 
15 bad_addr_filter [5] -> [1] output; 

bad_addr_filter [6] ->[1] output; 

bad_addr_filter [7] ->[1] output; 

bad_addr_filter [8] ->[1] output; 

bad_addr_filter [9] -> [1] output; 
20 bad_addr_filter [10] -> [1] output; 

bad_addr_filter [1 1] -> [1] output; 

bad_addr_filter [12] -> [1] output; 

bad_addr_filter [13] -> [1] output; 

bad_addr_filter [14] -> [1] output; 
25 bad_addr_fllter [15] -> [1] output; 

// ICMP rules: drop all fragmented and redirect ICMP packets 

bad_addr_filter [16] 
30 -> is_icmp_frag_packets : : Classifier(6/0000, -); 
is_icmp_frag_packets [1] -> [1] output; 

is_icmp_frag_packets [0] 
-> is_icmp_redirect :: IPClassifier(icmp type 5, -); 
35 is_icmp_redirect [0] -> [1] output; 

// finally, allow dynamic filtering of bad src addresses we discovered 
// elsewhere in our script. 

40 dyn_saddr_filter : : AddrFilter(SRC, 32); 
is_icmp_redirect [1] -> dyn_saddr_filter; 
bad_addr_filter [17] -> dyn_saddr_filter; 
dyn_saddr_filter [0] -> [0] output; 
dyn_saddr_filter [1] -> [1] oulput; 

45 

}; 
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= monitor.click 



// 

5 // TCPTrafficMonitor 

// 

// expects: input 0 takes TCP packets w IP header for the victim network; 
// input 1 takes TCP packets w IP Header from the victim network. 
// action: monitors packets passing by 
10 // outputs: output 0 - packets for victim network, unmodified; 
// output 1 - packets from victim network, unmodified. 
// 

elementclass TCPTrafficMonitor { 
15 // fwd annotation = rate of src_addr, rev annotation = rate of dst_addr 
tcp_rm :: DPRateMonitor(PACKETS, 0, 1, 100, 4096, true); 

// monitor all TCP traffic to victim, monitor non-RST packets from victim 
input [0] -> [0] tcpjm [0] -> [0] output; 
20 input [1] -> il Jcp_rst :: IPClassifier(rst, -); 
il Jcpjrst[0] -> [1] output; 
il_tcp_rst[l] -> [1] tcpjtm [1] -> [1] output; 

}; 

25 



30 20094505.doc 
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Appendix listing of additional Click modules ("elements"). 
ADAPTIVESHAPER (n) ADAPTIVESHAPER (n) 

5 

NAME 

AdaptiveShaper - Click element 
SYNOPSIS 

10 AdaptiveShaper (DROP_P, REPRESSJfEIGHT) 

PROCESSING TYPE 
Push 

15 DESCRIPTION 

AdaptiveShaper is a push element that shapes input traffic 
from input port 0 to output port 0. Packets are shaped 
based on "repressive" traffic from input port 1 to output 
port 1. Each repressive packet increases a multiplicative 

20 factor f by REPRESS_WEIGHT . Each input packet is killed 

instead of pushed out with f * DROP_P probability. After 
each dropped packet, f is decremented by 1. 



25 EXAMPLES 

ELEMENT HANDLERS 

dropjprob (read/write) 
value of DROP P 



30 



35 



repress_weight (read/ write) 
value of REPRESS WEIGHT 



SEE ALSO 

40 PacketShaper (n) , RatioShaper (n) 



45 



50 



55 
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ADAPT IVES PL I TTER ( n ) ADAPT I VE S PL I TTER ( n ) 



NAME 

5 AdaptiveSplitter - Click element 

SYNOPSIS 

AdaptiveSplitter (RATE) 

10 PROCESSING TYPE 
Push 

DESCRIPTION 

AdaptiveSplitter attempts to split RATE number of packets 
15 per second for each address. It takes the fwd_rate annota- 

tion set by IPRateMonitor (n) , and calculates a split prob- 
ability based on that rate. The split probability attempts 
to guarantee RATE number of packets per second. That is, 
the lower the fwd_rate, the higher the split probability. 

20 

Splitted packets are on output port 1. Other packets are 
on output port 0. 



25 EXAMPLES 

AdaptiveSplitter (10) ; 



30 

SEE ALSO 

IPRateMonitor (n) 



35 



40 



45 



50 
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ADDRFILTER (n) ADDRFILTER (n) 



NAME 

5 . AddrFilter - Click element 

SYNOPSIS 

AddrFilter (DST/SRC, N) 

10 PROCESSING TYPE 
Push 

DESCRIPTION 

Filters out IP addresses given in write handler, DST/SRC 
15 specifies which IP address (dst or src) to filter. N is 

the maximum number of IP addresses to filter at any time. 
Packets passed the filter goes to output 0. Packets 
rejected by the filter goes to output 1. 

20 AddrFilter looks at addresses in the IP header of the 

packet, not the annotation. It requires an IP header anno- 
tation ( MarklPHeader (n) ) . 



25 EXAMPLES 

AddrFilter (DST, 8) 



30 



35 



Filters by dst IP address, up to 8 addresses. 



ELEMENT HANDLERS 

table. { (read) ) 

Dumps the list of addresses to filter and 



add ((write)) 

Expects a string "addr mask duration", where addr is 
40 an IP address, mask is a netmask, and duration is the 

number of seconds to filter packets from this IP 
address. If 0 is given as a duration, filtering is 
removed. For example, "18.26.4.0 255.255.255.0 10" 
would filter out all packets with dst or source 
45 address 18.26.4.* for 10 seconds . New addresses push 

out old addresses if more than N number of filters 
already exist. 



50 



reset ((write)) 

Resets on write. 



55 SEE ALSO 

Classifier (n) , MarklPHeader (n) 
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ATTACKLOG (n) ATTACKLOG (n) 



NAME 

5 AttackLog - Click element; maintains a log of attack pack- 

ets in SAVE_FILE. 

SYNOPSIS 

AttackLog (SAVE^FILE, INDEX_FILE, MULTIPLIER, PERIOD) 

10 

PROCESSING TYPE 
Agnostic 

DESCRIPTION 

15 Maintains a log of attack packets in SAVE_FILE. Expects 

packets with ethernet headers, but with the first byte of 
the ethernet header replaced by an attack bitmap, set in 
kernel. AttackLog classifies each packet by the type of 
attack, and maintains an attack rate for each type of 

20 attack. The attack rate is the arrival rate of attack 

packets multiplied by MULTIPLIER. 

AttackLog writes a block of data into SAVE_FILE once every 
PERIOD number of seconds. Each block is composed of 
25 entries of the following format: 

delimiter (0s) 4 bytes 

time 4 bytes 

attack type 2 bytes 

30 attack rate 4 bytes 

ip header and payload (padded) 86 bytes 

100 bytes 

35 Entries with the same attack type are written out 

together. A delimiter of OxFFFFFFFF is written to the end 
of each block. 

A circular timed index file is kept in INDEX_FILE along 
40 side the attacklog. See Circularlndex (n) . 



SEE ALSO 
45 Circularlndex (n) 



-39- 



WO 02/21296 



PCT/US01/27394 



CIRCULARINDEX(n) 



CIRCULARINDEX(n) 



NAME 



5 



Circularlndex - Click element; writes a timed circular 
index into a file. 



SYNOPSIS 



Circularlndex 



10 



DESCRIPTION 



Circularlndex writes an entry into a circular index file 
periodically. The entry contains a 32 bit time stamp and a 
64 bit offset into another file. The following functions 



int initialize (String FILE, unsigned PERIOD, unsigned 
■ WRAP) - Use FILE as the name of the circular file. Writes 
entry into circular file once every PERIOD number of sec- 
onds. WRAP is the number of writes before wrap around. If 
WRAP is 0, the file is never wrapped around. 

void write_entry(long long offset) - Write entry into 
index file. Use offset as the offset in the entry. 



15 



are exported by Circularlndex. 



25 



SEE ALSO 



GatherRates (n) , MonitorSRC16 (n) 



30 
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DISCARDTO DEVICE (n) DISCARDTODEVICE (n) 



NAME 

5 DiscardToDevice - Click element; drops all packets, gives 

skbs to device. 

SYNOPSIS 

DiscardToDevice (DEVICE) 

10 

PROCESSING TYPE 
Agnostic 

DESCRIPTION 

15 Discards all packets received on its single input. Gives 

all skbuffs to specified device. 



20 
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PCT/US01/27394 
FILTERTCP (n) 



NAME 

FilterTCP - Click element 

SYNOPSIS 

' FilterTCP ( ) 

PROCESSING TYPE 
Push 

DESCRIPTION 

Expects TCP/IP packets as input. 
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FROMTUNNEL { n ) FROMTUNNEL ( n ) 



NAME 

5 FromTunnel - Click element 

SYNOPSIS 

FromTunnel (TUNNEL, SIZE, BURST) 

10 PROCESSING TYPE 
Push 

DESCRIPTION 

'Grab packets from kernel KUTunnel element. TUNNEL is a 
15 /proc file in the handler directory of the KUTunnel ele- 

ment. SIZE specifies size of the buffer to use (if packet 
in kernel has larger size, it is dropped) . BURST specifies 
the maximum number of packets to push each time FromTunnel 
runs. 

20 

EXAMPLES 

FromTunnel ( /proc/click/tunnel/conf ig) 

25 
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GATHERRATES (n) GATHERRATES (n) 



NAME 

5 GatherRates - Click element 

SYNOPSIS 

GatherRates (SAVE_FILE, INDEXJFILE, TCPMONITOR_IN, TCPMONI- 
TOR_OUT, MONITOR_PERIOD, SAVE_PERIOD) ; 

10 

PROCESSING TYPE 
Agnostic 

DESCRIPTION 

15 Gathers aggregate traffic rates from TCPMonitor (n) element 

at TCPMONITOR_IN and TCPMONITOR_OUT. 

Aggregate rates are gathered once every MONITOR_PERIOD 

number of seconds. They are averaged and saved to 
20 . SAVE_FILE once every SAVE_PERIOD number of seconds . The 

following entry is written to SAVE_FILE for both incoming 
and outgoing traffic: 

delimiter (0s) 4 bytes 

25 time 4 bytes 
type (0 for incoming traffic, 1 for outgoing traffic) 4 bytes 

packet rate of tcp traffic 4 bytes 

byte rate of tcp traffic 4 bytes 

rate of fragmented tcp packets 4 bytes 

30 rate of tcp syn packets 4 bytes 

rate of tcp fin packets 4 bytes 

rate of tcp ack packets 4 bytes 

rate of tcp rst packets 4 bytes 

rate of tcp psh packets 4 bytes 

35 rate of tcp urg packets 4 bytes 

packet rate of non-tcp traffic 4 bytes 

byte rate of non-tcp traffic 4 bytes 

rate of fragmented non-tcp traffic 4 bytes 

rate of udp packets 4 bytes 

40 rate of icmp packets 4 bytes 

rate of all other packets 4 bytes 



72 bytes 

45 

After the two entries, an additional delimiter of 
OxFFFFFFFF is written. SAVE__PERIOD must be a multiple of 
MONITOR_PERIOD. 

50 A circular timed index is kept along side the stats file. 

See Circularlndex(n) . 



55 SEE ALSO 

TCPMonitor (n) Circularlndex (n) 
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ICMPPINGENCAP (n) ICMPPINGENCAP (n) 

NAME 

5 ICMPPINGEncap - Click element 

SYNOPSIS 

ICMPPINGEncap (SADDR, DADDR [, CHECKSUM?]) 



10 DESCRIPTION 

Encapsulates each incoming packet in a .ICMP ECHO/IP packet 
with source address SADDR and destination address DADDR. 
The ICMP and IP checksums are calculated if CHECKSUM? is 
true; it is true by default. 



EXAMPLES 

ICMPPINGEncap (1.0. 0.1, 2.0.0.2) 



20 



-45- 



WO 02/21296 



PCT/USO 1/27394 



KUTUNNEL (n) KUTUNNEL (n) 



NAME 

5 KUTunnel - Click element; stores packets in a FIFO queue 

that userlevel Click elements pull from. 

SYNOPSIS 

KUTunnel ( [CAPACITY] ) 

10 

PROCESSING TYPE 
Push 

DESCRIPTION 

15 Stores incoming packets in a first-in-first-out queue. 

Drops incoming packets if the queue already holds CAPACITY 
packets. The default for CAPACITY is 1000. Allows user- 
level elements to pull from queue via ioctl. 

20 

ELEMENT HANDLERS 

length (read-only) 

Returns the current number of packets in the queue. 



25 



30 



35 



40 



highwater_length (read-only) 

Returns the maximum number of packets that have ever 
been in the queue at once. 



capacity (read/write) 

Returns or sets the queue's capacity. 



drops (read-only) 

Returns the number of packets dropped so far. 



45 SEE ALSO 

Queue (n) 
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LOGGER (n) LOGGER (n) 



NAME 

5 Logger - Click element 

SYNOPSIS 

Logger (LOGFILE, INDEXFILE [, LOCKFILE, COMPRESS?, LOGSIZE, 
PACKETSIZE, WRITEPERIOD, IDXCOALESC, PACKET FREQ, MAXBUF- 
10 SIZE ] ) 

PROCESSING TYPE 
Agnostic 

15 DESCRIPTION 

Has one input and one output. 

Write packets to log file LOGFILE. A log file is a circu- 
lar buffer containing packet records of the following 
20 form: 



| time (6 bytes) 
I length (2 bytes) 
25 I packet data 



Time is the number of seconds and milliseconds since the 
Epoch at which a given packet was seen. Length is the 
30 length (in bytes) of the subsequent logged packet data. 

One or more packet records constitute one packet sequence. 

INDEXFILE maintains control data for LOGFILE. It contains 
a sequence of sequence control blocks of the following 
35 form: 



I date (4 bytes) I 
| offset (sizeof off_t) I 
40 I length (sizeof off_t) I 



Date is a number of seconds since the Epoch. Offset 
points to the beginning of the packet sequence, i.e. to 
45 the earliest packet record having a time no earlier than 

date. Length is the number of bytes in the packet 
sequence. IDXCOALESC is the number of coalescing packets 
that a control block always cover. Default is 1024. 

50 Sequence control blocks are always stored in increasing 

chronological order; offsets need not be in increasing 
order, since LOGFILE is a circular buffer. 

COMPRESS? (true, false) determines whether packet data is 
55 logged in compressed form. Default is true. 
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LOGSIZE specifies the maximum allowable log file size,, in 
KB. Default is 2GB. LOGSIZE=0 means "grow as necessary". 

PACKETSIZE is the amount of packet data stored in the log. 
5 By default, the first 120 (128-6-2) bytes are logged and 

the remainder is discarded. Note that PACKETSIZE is the 
amount of data logged before compression. 

Packet records are buffered in memory and periodically 
written to LOGFILE as a packet sequence. WRITEPERIOD is 
the number of seconds that should elapse between writes to 
LOGFILE. Default is 60. INDEXFILE is updated every time a 
sequence of buffered packet records is written to LOGFILE. 
The date in the sequence control block is the time of the 
first packet record of the sequence, with milliseconds 
omitted. 



10 



15 



PACKET FREQ is an estimate of the number of packets per 
second that will be passing through Logger. Combined with 

20 WRITEPERIOD, this is a hint of buffer memory requirements. 

By default, PACKET FREQ is 1000. Since by default WRITEPE- 
RIOD is 60 and each packet record is at most 128 bytes, 
Logger normally allocates 7500KB of memory for the buffer. 
Logger will grow the memory buffer as needed up to a maxi- 

25 mum of MAXBUFSIZE KB, at which point the buffered packet 

records are written to disk even if WRITEPERIOD seconds 
have not elapsed since the last write. Default MAXBUFSIZE 
is 65536 (64MB) . 

30 
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MONITORSRC16 (n) MONITORSRC16 (n) 



NAME 

5 . MonitorSRC16 - Click element 

SYNOPSIS 

Monitor SRC 16 (SAVE_FILE, INDEX_FILE, MULTIPLIER, PERIOD, 
WRAP) 

10 

PROCESSING TYPE 
Agnostic 

DESCRIPTION 

15 Examines src address of packets passing by. Collects 

statistics for each 16 bit IP address prefix. The follow- 
ing data structure is written to SAVE_FILE for every 16 
bit IP address prefix every PERIOD number of seconds. 



20 


delimiter (0s) 


(4 


bytes) 




time 


(4 


bytes) 




addr 


(4 


bytes) 




tcp rate 


(4 


bytes) 




non tcp rate 


(4 


bytes) 


25 


percent of tcp 


(1 


byte) 




percent of tcp frag 


(1 


byte) 




percent of tcp syn 


(1 


byte) 




percent of tcp fin 


(1 


byte) 




• percent of tcp ack 


(1 


byte) 


30 


percent of tcp rst 


(1 


byte) 




percent of tcp psh 


(1 


byte) 




percent of tcp urg 


(1 


byte) 




percent of non tcp frag 


(1 


byte) 




percent of udp 


(1 


byte) 


35 


percent of icmp 


{1 


byte) 




reserved 


(1 


byte) 



32 bytes 



40 TCP and non TCP rates are multiplied by MULTIPLIER. An 

additional delimiter of OxFFFFFFFF is written at the end 
of a block of entries. 

WARP specifies the number of writes before wrap-around. 
45 For example, if PERIOD is 60, WARP is 5, then every 5 min- 

utes, the stats file wrap around. 

A timed circular index is maintained along side the 
statistics file in INDEXJETLE. See Circularlndex (n) . 

50 



SEE ALSO 

Circularlndex (n) 

55 
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RANDOMTCPI PENCAP (n) RANDOMTCPIPENCAP (n) 



NAME 

5 RandomTCPIPEncap - Click element 

SYNOPSIS 

RandomTCPIPEncap (DA BITS [DP SEQN ACKN CHECKSUM SA MASK] ) 

10 PROCESSING TYPE 
Agnostic 

DESCRIPTION 

Encapsulates each incoming packet in a TCP/IP packet with 
random source address and source port, destination address 
DA, and control bits BITS. If BITS is -1, control bits 
are also generated randomly. If destination port DP, 
sequence number SEQN, or ack number ACKN is specified and 
non-zero, it is used. Otherwise, it is generated randomly 
for each packet. IP and TCP checksums are calculated if 
CHECKSUM is true; it is true by default. SEQN and ACKN 
should be in host order. SA and MASK are optional IP 
address; if they are specified, the source address is com- 
puted as ((randomf) & MASK) | SA) . 



EXAMPLES 

RandomTCPI PEncap (1.0.0.2 4 ) 

30 



SEE ALSO 

RoundRobinTCPI PEncap (n) , RandomUDPI PEncap (n) 
35 



15 



20 



25 
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10 



20 



RANDOMUDPI PENCAP (n) RANDOMUDPIPENCAP (n) 



NAME 

RandomUDPIPEncap — Click element 
SYNOPSIS 

RandomUDPIPEncap {SAD DR SPORT DADDR DPORT PROB [CHECKSUM?] 
[i ..•]) 

PROCESSING TYPE 
Agnostic 



DESCRIPTION 

15 Encapsulates each incoming packet in a UDP/IP packet with 

source address SADDR, source port SPORT, destination 
address DADDR, and destination port DPORT. The UDP check- 
sum is calculated if CHECKSUM? is true; it is true by 
default. 



PROB gives the relative chance of this argument be used 
over others. 



The RandomUDPIPEncap element adds both a UDP header and an 
25 IP header. 

You can a maximum of 16 arguments. Each argument specifies 
a single UDP/IP header. The element will randomly pick one 
argument. The relative probabilities are determined by 
30 PROB . 

The Strip (n) element can be used by the receiver to get 
rid of the encapsulation header. 

35 EXAMPLES 

RandomUDPIPEncap (1. 0.0.1 1234 2.0.0.2 1234 1 1, 

1.0.0.2 1093 2.0.0.2 1234 2 1) 

Will send about twice as much UDP/IP packets with 1.0.0.2 
40 as its source address than packets with 1.0.0.1 as its 

source address. 



45 SEE ALSO 

Strip (n) , UDPIPEncap (n) , RoundRobinUDPIPEncap (n) 
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NAME 

•5 RateWam - Click element; classifies traffic and sends out 

warnings when rate of traffic exceeds specified rate. 

SYNOPSIS 

RateWam (RATE, WARNFREQ) 

10 

PROCESSING TYPE 
Push 

DESCRIPTION 

15 RateWam has three output ports. It monitors the rate of 

packet arrival on input port 0. Packets are forwarded to 
output port 0 if rate is below RATE. If rate exceeds 
RATE, it sends out a warning packet WARNFREQ number of 
seconds apart on output port 2 in addition to forwarding 

20 all traffic through output port 1. 



SEE ALSO 

PacketMeter (n) 

25 
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RATIOSHAPER (n) RATIOSHAPER(n) 



NAME 

5 RatioShaper - Click element 

SYNOPSIS 

RatioShaper (FWD_WEIGHT, REV_WEIGHT, THRESH, P) 

10 PROCESSING TYPE 
Push 

DESCRIPTION 

RatioShaper shapes packets based on fwd_rate_anno and 
15 rev_rate_anno rate annotations set by IPRateMonitor (n) . 

If either annotation is greater than THRESH, and 
FWDJWEIGHT*fwd_rate_anno > REV_WEIGHT*rev_rate_anno, the 
packet is moved onto output port 1 with a probability of 

20 mind, 

P* (fwd_rate_anno*FWD_WEIGHT) / (rev_rate_anno*REV_WEIGHT) ) 

FWD_WEIGHT, REV_WEIGHT, and THRESH are integers. P is a 
decimal between 0 and 1. Otherwise, packet is forwarded on 
25 output port 0. 



EXAMPLES 

30 RatioShaper (1, 2, 100, .2); 

if fwd_rate_anno more than twice as big as rev_rate_anno, 
and both rates are above 100, drop packets with an initial 
probability of 20 percent. 



ELEMENT HANDLERS 

fwd_weight (read/write) 
40 value of FWD_WEIGHT 



rev_weight (read/write) 
value of REV_WEIGHT 

45 

thresh (read/write) 
value of THRESH 

50 

drop_j?rob (read/write) 
value of P 



55 

SEE ALSO 

Block (n) , IPRateMonitor (n) 
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RE PORT ACTIVITY (n) REPORTACTIVITY (n) 



NAME 

5 ReportActivity - Click element 

SYNOPSIS 

ReportActivity (SAVE_FILE, IDLE) 

10 PROCESSING TYPE 
Agnostic 

DESCRIPTION 

Write into SAVE_ FILE a 32 bit time value followed by an 
15 ASCII representation of that time stamp whenever a packet 

comes by. If IDLE number of seconds pass by w/o a packet, 
removes the file. 



20 



-54- 



WO 02/21296 



PCT/US01/27394 



ROUNDROBINSETIPADDRESS (n) ROUNDROBINSETIPADDRESS (n) 



NAME 

5 RoundRobinSetlPAddress - Click element 

SYNOPSIS 

RoundRobinSetlPAddress (ADDR [, . . . ] ) 

10 PROCESSING TYPE 
Agnostic 

DESCRIPTION 

Set the destination IP address annotation of each packet 
15 with an address chosen from the configuration string in 

round robin fashion. Does not compute checksum (use 
SetlPChecksum(n). or SetUDPTCPChecksum (n) ) or encapsulate 
the packet with headers (use RoundRobinUDPIPEncap (n) or 
RoundRobinTCPIPEncap(n) with bogus address). 

20 

EXAMPLES 

RoundRobinUDPIPEncap (2. 0.0. 2 0.0.0.0 0 0 0) 

-> RoundRobinSetlPAddress (1.0.0.2, 1.0.0.3, 1.0.0.4) 
25 -> StoreIPAddress(12) 

-> SetlPChecksum 
-> SetUDPTCPChecksum 

this configuration segment places an UDP header onto each 
30 1 packet, with randomly generated source and destination 

ports. The destination IP address is 2.0.0.2, the source 
IP address is 1.0.0.2, or 1.0.0.3, or 1.0.0.4. Both IP and 
UDP checksum are computed. 

35 

SEE ALSO 

RoundRobinUDPIPEncap (n) , RoundRobinTCPIPEncap (n) , UDPIPEn- 
cap(n) , * SetlPChecksum (n) , SetUDPTCPChecksum (n) , SetlPAd- 
40 dress (n) , StorelPAddress (n) 
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ROUNDROBINTCPIPENCAP (n) ROUNDROBINTCPIPENCAP (n) 



NAME 

5 RoundRobinTCPIPEncap - Click element 

SYNOPSIS 

RoundRobinTCPIPEncap (SA DA BITS [SP DP SEQN ACKN CHECKSUM] 
[, -.J) 

10 

PROCESSING TYPE 
Agnostic 

DESCRIPTION 

15 Encapsulates each incoming packet in a TCP/IP packet with 

source address SA, source port SP (if 0, a random one is 
generated for each packet), destination address DA, and 
destination port DP (if 0, a random one is generated for 
each packet), and control bits BITS. If SEQN and ACKN 

20 specified are non-zero, they are used. Otherwise, they 

are randomly generated for each packet. IP and TCP check- 
sums are calculated if CHECKSUM is true; it is true by 
default. SEQN and ACKN should be in host order. 

25 The RoundRobinTCPIPEncap element adds both a TCP header 

- and an IP header. 

You can give as many arguments as you'd like. Each argu- 
ment specifies a single TCP/IP header. The element will 
30 cycle through the headers in round-robin order. 

The Strip (n) element can be used by the receiver to get 
rid of the encapsulation header. 

35 EXAMPLES 

RoundRobinTCPIPEncap (2. 0.0.2 1.0.0.2 4 1022 1234 42387492 
2394839 1, 

2.0.0.2 1.0.0.2 2) 

40 



SEE ALSO 

Strip (n) , RoundRobinUDPIPEncap (n) 

45 
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ROUNDROBINUDPIPENCAP (n) 



ROUNDROBINUDPIPENCAP (n) 



NAME 



5 



RoundRobinUDPIPEncap - Click element 



SYNOPSIS 



RoundRobinUDPIPEncap (SADDR DADDR [SPORT DPORT CHECKSUM?] 
'[,...]) 



PROCESSING TYPE 
Agnostic 

DESCRIPTION ■ 

15 Encapsulates each incoming packet in a UDP/IP packet with 

source address SADDR, source port SPORT, destination 
address DADDR, and destination port DPORT. The UDP and IP 
checksums are calculated if CHECKSUM? is true; it is true 
by default. If either DPORT or SPORT is 0, the port will 

20 be randomly generated for each packet. 



The RoundRobinUDPIPEncap element adds both a UDP header 
and an IP header. 

You can give as many arguments as you'd like. Each argu- 
ment specifies a single UDP/IP header. The element will 
cycle through the headers in round-robin order. 

The Strip (n) element can be used by the receiver to get 



10 



30 



rid of the encapsulation header. 



EXAMPLES 



RoundRobinUDPIPEncap (2. 0.0.2 1.0.0.2 1234 1002 1, 

2.0.0.2 1.0.0.2 1234) 



35 



SEE ALSO 



40 



Strip (n) , UDPIPEncap (n) 
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SETSNI FFFLAGS (n) SETSNIFFFLAGS (n) 



NAME 

5 SetSnif fFlags - Click element; sets sniff flags annota- 

tion. 

SYNOPSIS 

SetSnif fFlags (FLAGS [, CLEAR] ) 

10 

PROCESSING TYPE 
Agnostic 



DESCRIPTION 

15 Set the sniff flags annotation of incoming packets to 

FLAGS bitwise or with the old flags, if CLEAR is true 
(false by default), the old flags are ignored. 



20 
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SETUDPTCPCHECKSUM (n) SETUDPTCPCHECKSUM (n) 



NAME 

5 SetUDPTCPChecksum - Click element 

SYNOPSIS 

SetUDPTCPChecksum ( ) 

10 PROCESSING TYPE 
Agnostic 

DESCRIPTION 

Expects an IP packet as input . Calculates the ICMP, UDP or 
15 TCP header's checksum and sets the checksum header field. 

Does not modify packet if it is not an ICMP, UDP, or TCP 
packet . 

20 SEE ALSO 

• SetlPChecksum(n) 
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STORESNIFFFLAGS (n) STORESNI FFFLAGS (n) 



NAME 

5 StoreSniff Flags - Click element; stores sniff flags anno- 

tation in packet 

SYNOPSIS 

StoreSniff Flags (OFFSET) 

10 

PROCESSING TYPE 
Agnostic 

DESCRIPTION 

15 copy the sniff flags annotation into the packet at offset 

OFFSET . 
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TCPMONITOR(n) TCPMONITOR (n) 



NAME 

5 TCPMonitor - Click element 

SYNOPSIS 

TCPMonitor () 

10 PROCESSING TYPE 
Push 

DESCRIPTION 

Monitors and splits TCP traffic. Output 0 are TCP traffic, 
15 output 1 are non-TCP traffic. Keeps rates of TCP, TCP 

BYTE, SYN, ACK, PUSH, RST, FIN, URG, and fragmented pack- 
ets. Also keeps rates of ICMP, UDP, non-TCP BYTE, and non- 
TCP fragmented traffic. 

20 

ELEMENT HANDLERS 

rates (read) 

dumps rates 

25 
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TCPSYNPROXY (n) TCPSYNPROXY (n) 



NAME 

5 TCPSYNProxy - Click element 

SYNOPSIS 

TCPSYNProxy (MAX_C0NNS , THRESHOLD, MINJTIMEOUT, MAXJTIMEOUT 
[, PASSIVE] ) 

10 

PROCESSING TYPE 
Push 



DESCRIPTION 

15 Help settup a three way TCP handshake from A to B by sup- 

plying the last ACK packet to the SYN ACK B sent prema- 
turely, and send RST packets to B later if no ACK was 
received from A. 



20 Expects IP encapsulated TCP packets,, each with its ip 

header marked ( MarklPHeader (n) or ChecklPHeader (n) ) . 

Aside from responding to SYN ACK packets from B, TCPSYN- 
Proxy also examines SYN packets from A. When a SYN packet 
25 from A is received, if there are more than MAX_CONNS num- 

ber of outstanding 3 way connections per destination 
(daddr + dport) , reject the SYN packet. If MAX_CONNS is 0, 
no maximum is set. 

The duration from sending an ACK packet to B to sending a 
RST packet to B decreases exponentially as the number of 
outstanding connections to B increases pass 2 A THRESHOLD. 
The minimum timeout is MINJTIMEOUT. If the number of out- 
standing half-open connections is above 2 A THRESHOLD, the 
timeout is 



30 



35 



max {MINJTIMEOUT, MAXJTIMEOUT » (N» THRESHOLD)) 

Where N is the number of outstanding half-open connec- 
tions. For example, let the MINJTIMEOUT value be 4 sec- 
onds, the MAXJTIMEOUT value be 90 seconds, and THRESHOLD 
be 3. Then when N < 8, timeout is 90. When N < 16, timeout 
is 45. When N < 24, timeout is 22 seconds. When N < 32, 
timeout is 11 seconds. When N < 64, timeout is 4 seconds. 
Timeout period does not decrement if the threshold is 0. 

TCPSYNProxy has two inputs, three outputs. All inputs and 
outputs take in and spew out packets with IP header. 
Input 0 expects TCP packets from A to B. Input 1 expects 
50 TCP packets from B to A. Output 0 spews out packets from A 

to B. Output 1 spews out packets from B to A. Output 2 
spews out the ACK and RST packets generated by the ele- 
ment. 

55 If PASSIVE is true (it is not by default), monitor TCP 

three-way handshake instead of actively setting it up. In 



40 



45 
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this case, no ACK or RST packets will be sent. When an 
outstanding SYN times out, the SYN ACK packet is sent out 
of output port 2. No packets on port 0 are modified or 
dropped in this operating mode. 



EXAMPLES 

... -> ChecklPHeaderO -> TCPSYNProxy (128, 3, 10, 90) -> 

10 



ELEMENT HANDLERS 
15 summary (read) 

Returns number of ACK and RST packets sent and number 
of SYN packets rejected. 



20 

table (read) 

Dumps the table of half-opened connections. 



25 

reset (write) 

Resets on write. 



30 



SEE ALSO 

MarklPHeader (n) , ChecklPHeader (n) 

35 
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TCPSYNRESP (n) TCPSYNRESP (n) 



NAME 

5 TCPSYNResp - Click element 

SYNOPSIS 

TCPSYNResp ( ) 

10 PROCESSING TYPE 
Push 

DESCRIPTION 

Takes in TCP packet, if it is a SYN packet, return a SYN 
15 ACK. This is solely for debugging and performance tunning 

purposes. No checksum is done. Spews out original packet 
on output 0 untouched. Spews out new packet on output 1. 



20 



25 

201094509.doc 
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What is claimed is: 

1. A method of monitoring traffic flow in a monitor 
device disposed to receive network traffic packets 
comprises: 

producing statistics corresponding to a parameter of 
traffic flow to trace the source of an attack, with 
producing further comprising: 

mapping the traffic flow into a plurality of 
buckets by applying a hash function *f(h)" to the 
parameter of the traffic flow to output an integer 
corresponding to one of the buckets; 

accumulating statistics from the packets; and 
comparing the number of buckets to a threshold; 

and 

determining whether the number of buckets should be 
divided into more buckets or combined into fewer buckets 
based on comparing the number of buckets to the threshold, 

2. The method of claim 1 wherein the buckets are storage 
20 areas in a memory space of the monitor device. 

3. The method of claim- 1 wherein as the number of 
buckets changes, the buckets have values derived from the 
buckets prior to the change. 

25 

4. The method of claim 1 wherein the hash function 
adapts to map to the new number of buckets, as the new 
number of buckets changes. 

30 5. The method of claim 1 wherein comparing statistic 
values comprises: 

comparing the value accumulated in the bucket to a 
threshold that depends on the number of buckets. 



10 
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6. The method of claim 1 wherein the parameter is the 
count of how many packets a data collector or gateway 
examines. 

5 

7. The method of claim 1 wherein as a value of a 
parameter for one bucket approaches a threshold, the 
monitoring device raises an alarm. 

10 8. The method of claim 1 wherein the hash function 

changes periodically in a randomly secret manner so that 
packets are reassigned to different buckets. 

9. The method of claim 1 wherein the variable number of 
15 buckets dynamically adjusts the amount of traffic and 
number of flows monitored, so that the monitoring device 
is not vulnerable to a denial of service attack against 
its own resources. 

20 10. The method of claim 1 wherein the variable number of 
buckets efficiently identifies the source or sources of 
attack by breaking down traffic into different buckets and 
examining statistics accumulated for a parameter and a 
corresponding threshold in each bucket. 

25 

11. The method of claim 1 wherein the traffic is 
monitored at multiple levels of granularity, from 
aggregate to individual flows. 

30 12. The method of claim 1 wherein the traffic is applied 
to monitoring of TCP packet ratios and repressor traffic. 
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13. The method of claim 1 wherein the threshold is a 
first threshold and the method further comprises: 

comparing accumulated statistic values from the 
buckets to second threshold values to determine that an 
5 event is of significance. 

14. A computer program product residing on a computer 
readable for monitoring network traffic flow in a network 
comprises instructions for causing a computer to: 

map traffic flow into a plurality of buckets by 
applying a hash function "f(h)" to a parameter of the 
traffic flow to output an integer corresponding to one of 
the buckets; 

accumulate statistics from the packets; and 
compare the accumulated statistic values from the 
buckets to configured threshold values corresponding to 
the number of buckets to determine that an event is of 
significance; and 

adjust the number of buckets as the number of buckets 
approaches a second threshold. 

15. The computer program product of claim 14 wherein 
based on the second threshold, the buckets are divided 
into more buckets or combined into fewer buckets 

25 

16. The computer program product of claim 14 wherein 
instructions to monitor further comprise instructions to 

divide the bucket into a different number of new 
buckets containing values derived from the original 
30 bucket. 



10 



15 



20 
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17 . The computer program product of claim 14 wherein the 
hash function adapts to map to the new number of buckets 
as the new number of buckets changes. 

5 18. The computer program product of claim 14 wherein the 
parameter is the count of how many packets a data 
collector or gateway examines. 

19. The computer program product of claim 14 wherein the 
10 buckets are storage areas in the memory space of the 

monitor device. 

20. The computer program product of claim 14 wherein the 
hash function changes periodically in a randomly secret 

15 manner so that packets are reassigned to different 
buckets. 

21. A data collector to collect statistical information 
about network flows comprises: 

a computer readable medium; 

a computing device that executes a computer program 
product stored on the computer readable medium comprising 
instructions to cause the computing device to: 

map traffic flow into a plurality of buckets by 
applying a hash function "f(h)" to the parameter of 
the traffic flow to output an integer corresponding 
to one of the buckets; 

accumulate statistics from the packets; and 
compare the accumulated statistic values from 
the buckets to configured threshold values 
corresponding to the number of buckets to determine 
that an event is of significance; and 
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adjust the number of buckets as the number of buckets 
approaches a second threshold; and 

a port to link the data collector to a central 
control center. 

5 

22. A method of detecting a denial of service attack on a 
victim site, the method comprising: 

monitoring network traffic sent to the victim site; 

determining a ratio of incoming to outgoing TCP 
10 packets destined and sourced from systems at the site; 

comparing the ratio to a threshold value; and 

raising an alarm when the ratio exceeds the threshold 
value. 

15 23. The method of claim 22 wherein monitoring further 
comprises: 

storing the determined ratio over periods of time; 

and 

analyzing the ratio to determine over time how much 
20 and how the ratio exceeds a value to set a threshold. 

24. The method of claim 22 wherein monitoring further 
comprises: 

establishing the ratio, and as the ratio exceeds that 
25 established threshold raising the alarm. 

25. The method of claim 22 wherein the ratio is about 2:1 
for incoming to outgoing TCP packets. 

30 26. The method of claim 22 wherein as the ratio exceeds 
the threshold it is a indication that the victim is 
receiving bad TCP traffic that are not part of any 
established TCP connection. 
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27. The method of claim 22 wherein as the ratio exceeds 
the threshold, exceeding the threshold raises an 
indication that the victim is overloaded to acknowledge 

5 the requests. 

28. The method of claim 22 wherein monitoring comprises: 
producing statistics corresponding to the ratio by 

mapping the traffic flow into a plurality of buckets by 
10 applying a hash function "f(h)" to the parameter of the 
traffic flow to output an integer corresponding to one of 
the buckets. 

29. the method of claim 28 further comprises: 

15 communicating the statistics collected to a control 

center. 

30. The method of claim 29 wherein communicating occurs 
over a dedicated link to the control center via a hardened 

20 network. 

31. The method of claim 30 executed on a gateway 
physically deployed in the network. 

25 32. A monitor device to collect statistical information 
about network flows comprises: 

a computer readable medium; 

a computing device that executes a computer program 
product stored on the computer readable medium comprising 
30 instructions to cause the computing device to: 

monitor network traffic sent to the victim site; 

determine a ratio of incoming to outgoing TCP packets 
destined and sourced from systems at the site; 
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compare the ratio to a threshold value; and 
raise an alarm when the ratio exceeds the threshold 
value. 

5 33. The monitor device of claim 32 wherein the monitor is 
a gateway. 

34. The monitor device of claim 32 wherein wherein the 
ratio is about 2:1 for incoming to outgoing TCP packets. 

10 

35. A method of detecting a denial of service attack on a 
victim site, the method comprising: 

monitoring network traffic sent to the victim site; 
determining a ratio of incoming to outgoing TCP 
15 packets destined and sourced from systems at the site; 
comparing the ratio to a threshold value; and 
raising an alarm when the ratio exceeds the threshold 
value. 

20 36. The method of claim 35 wherein monitoring further 
comprises: 

storing the determined ratio over periods of time; 

and 

analyzing the ratio to determine over time how much 
25 and how the ratio exceeds a value to set a threshold. 

37. The method of claim 35 wherein monitoring further 
comprises: 

establishing the ratio and as the ratio exceeds that 
30 threshold raising the alarm. 

38. The method of claim 35 wherein the ratio is about 
2:1, for incoming to outgoing TCP packets. 
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39. The method of claim 35 wherein the ratio is up to 
about 3:1, for incoming to outgoing TCP packets. 

40. The method of claim 35 wherein as the ratio exceeds 
5 the threshold it is a indication that the victim is 

receiving bad TCP traffic that are not part of any 
established TCP connection. 

41. The method of claim 35 wherein monitoring comprises: 
10 producing statistics corresponding to the ratio by 

mapping the traffic flow into a plurality of buckets by 
applying a hash function u f (h) " to source addresses of the 
traffic flow to output an integer corresponding to one of 
the buckets. 

15 

42. The method of claim 41 further comprises: 
communicating the statistics collected to a control 

center. 

20 43. The method of claim 42 wherein communicating occurs 
over a dedicated link to the control center via a hardened 
network. 

44. The method of claim 43 executed on a gateway 
25 physically deployed in the network. 

45. A method of detecting a denial of service attack on a 
victim site, the method comprising: 

monitoring network traffic sent to the victim site 
30 and identify packets generated from repressor traffic- 
analyzing message header information from identified 
packets; and 
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generating logs of contents of the message headers 
guard against attackes. 

46- The method of claim 45 wherein the logs are generated 
5 for forensic purposes or to selectively block future 
messages similar to the ones that caused the repressor 
traffic messages. 

10 47. The method of claim 45 wherein the repressor traffic 
is ICMP port unreachable messages that are generated by an 
end host when it receives a packet on a port that is not 
responding to requests. 

15 48. The method of claim 45 wherein repressor traffic is 
any network traffic that is indicative of problems or a 
potential attack in a main flow of traffic. 

49. The method of claim 45 wherein the method is executed 
20 on a gateway. 
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